NASA  Contractor  Report  195059 
ICASE  Report  No.  95-17 


ICASE 

EXPONENTIALLY  ACCURATE  APPROXIMATIONS 
TO  PIECE- WISE  SMOOTH  PERIODIC  FUNCTIONS 


James  Geer 
Nana  Saheb  Banerjee 


Contract  No.  NAS  1-19480 
March  1995 


19950505  135 


Institute  for  Computer  Applications  in  Science  and  Engineering 
NASA  Langley  Research  Center 
Hampton,  VA  23681-0001 


DTiS  3 


Operated  by  Universities  Space  Research  Association 


distribution  statement  a 

Approved  for  puhiic  release; 
Distribution  UnKmited 


EXPONENTIALLY  ACCURATE 
APPROXIMATIONS  TO  PIECE- WISE 
SMOOTH  PERIODIC  FUNCTIONS 


James  Geer*  and  Nana  Saheb  Banerjee 
Department  of  Systems  Science  and  Industrial  Engineering 
Watson  School  of  Engineering  and  Applied  Science 
Binghamton  University 
Binghamton,  New  York  13902 


ABSTRACT 

A  family  of  simple,  periodic  basis  functions  with  “built-in”  discontinuities  are  introduced, 
and  their  properties  are  analyzed  and  discussed.  Some  of  their  potential  usefulness  is  illus¬ 
trated  in  conjunction  with  the  Fourier  series  representation  of  functions  with  discontinuities. 
In  particular,  it  is  demonstrated  how  they  can  be  used  to  construct  a  sequence  of  approxima¬ 
tions  which  converges  exponentially  in  the  maximum  norm  to  a  piece-wise  smooth  function. 
The  theory  is  illustrated  with  several  examples  and  the  results  are  discussed  in  the  context 
of  other  sequences  of  functions  which  can  be  used  to  approximate  discontinuous  functions. 
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1.  Introduction.  Fourier  series  are  used  widely  in  many  branches  of  applied 
mathematics.  For  example,  they  are  often  used  together  with  separation  of  variables 
to  construct  analytical  solutions  to  boundary  value  problems  for  differential  equations, 
and  with  a  variety  of  spectral  methods  to  find  approximate  solutions  to  these  prob¬ 
lems  numerically.  For  practical  purposes,  approximate  solutions  to  these  problems  are 
often  obtained  using  only  a  finite  number  of  the  terms  in  a  Fourier  series.  This  trun¬ 
cation  procedure  may  lead  to  nonuniformly  valid  approximations.  In  particular,  when 
the  function  being  approximated  has  a  point  of  discontinuity,  the  Gibbs  phenomena  is 
present.  It  is  well  known  (see,  e.g.,  [1]  or  [12])  that  the  magnitude  of  the  “overshoot” 
associated  with  the  Gibbs  phenomena  is  not  eliminated  by  increasing  the  number  of 
terms  in  the  approximation,  but  rather  the  overshoot  approaches  an  asjmiptotic  hmit 
of  about  18%  as  the  number  of  terms  approaches  infinity.  In  addition,  for  any  Fourier 
series  partial  sum,  the  “oscillations”  caused  by  this  phenomena  typically  propagate  into 
regions  away  from  the  singularity,  and,  hence,  degrade  the  quahty  of  the  partial  sum 
approximation  in  these  regions. 

In  a  series  of  papers,  Gottlieb  and  several  of  his  co-investigators  [3], [4], [5], [6], [7] 
have  proposed  a  way  of  overcoming  the  Gibbs  phenomena.  Their  techmque  involves 
the  construction  of  a  new  series  using  the  Gegenbauer  polynomials.  For  a  function 
/  that  is  analytic  on  the  interval  [-1,1],  but  is  not  periodic,  they  prove  that  their 
technique  leads  to  a  series  which  converges  exponentially  to  f  in  the  maximum  norm. 
To  do  this,  they  require  that  the  parameter  A,  which  appears  in  the  weight  factor 
(1  _  grows  with  the  number  of  Fourier  modes  considered.  Recently,  Geer 

[2]  introduced  and  studied  a  class  of  approximations  {Fn,m}  to  a  periodic  function 
/  which  uses  the  ideas  of  Fade,  or  rational  function,  approximations  based  on  the 
Fourier  series  representation  of  /,  rather  than  on  the  Taylor  series  representation  of  / . 
Each  approximation  Fat.m  is  the  quotient  of  a  trigonometric  polynomial  of  degree  N 
and  a  trigonometric  polynomial  of  degree  M.  The  coefficients  in  these  polynomials  are 
determined  by  requiring  that  an  appropriate  number  of  the  Fourier  coefficients  of  Fn,m 
agree  with  those  of  f.  Explicit  expressions  were  derived  for  these  coefficients  in  terms  of 
the  Fourier  coefficients  of  /  and  it  was  proven  that  these  “Fourier-Pade”  approximations 
converge  point-wise  to  (/(x~*~)  f{x  ))/2  more  rapidly  (in  some  cases  by  a  factor  of 
1/k'^^)  than  the  Fourier  series  partial  siuns  on  which  they  were  based.  Although  these 
approximations  do  not  “eliminate”  the  Gibbs  phenomena,  they  do  nutigate  its  effect. 
In  particular,  the  asymptotic  value  of  the  magnitude  of  the  overshoot  is  reduced  to 
about  6%,  and,  outside  a  “small”  neighborhood  of  a  point  of  discontinuity  of  /,  the 
“unwanted”  oscillations  can  (for  practical  purposes)  essentially  be  eliminated. 

To  fix  notation,  we  let  /  be  a  27r-periodic  function  with  enough  smoothness  and 
regularity  properties  so  that  its  Fourier  series  exists  and  converges  to  f{x  ))/2 

for  all  -TT  <  X  <  TT.  Let  C^[-n,n]  denote  the  class  of  27r-periodic  functions  that  have 
at  least  M  continuous  derivatives  on  [-7r,7r].  Then  it  is  well  known  (see,  e.g.,  [1])  that, 
if  /  e  C^[-n,  tt],  then  the  Fourier  coefficients  (a^,  bj}  of  /  are  0(l/j^+^)  as  j  ^  oo. 
Moreover,  if  /  is  27r-periodic  and  analytic  on  [-7r,7r],  then  there  exists  a  constant  i9, 
with  0  <  6*  <  1,  such  that  aj  and  bj  are  O{0^),  as  j  — >  oo.  In  this  case,  it  follows  that 
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the  Fourier  series  of  /  converges  exponentially  to  /  in  the  maximum  norm. 

In  this  paper,  we  introduce  a  new,  simple  class  of  periodic  “basis”  functions  which 
have  certain  “built-in”  singularities,  and  which  can  be  used  to  construct  a  sequence  of 
approximations  which  converges  exponentially  to  /  in  the  maximum  norm.  In  particular, 
this  implies  that  the  Gibbs  phenomena  can  be  completely  eliminated,  even  when  /  has 
several  points  of  discontinuity  in  the  interval  [— '7r,7r].  In  section  2,  the  first  two  of 
these  basis  functions  are  introduced  and  it  is  shown  how  they  can  be  used  to  improve 
the  convergence  properties  of  a  function  with  one  or  more  singularities  in  the  interval 
[— TT,  tt].  These  ideas  are  illustrated  by  two  simple  examples  in  section  3.  In  section  4, 
the  complete  class  of  basis  frmctions  are  introduced,  and  various  convergence  properties 
of  approximations  constructed  using  them  are  studied  in  section  5.  In  particular,  it 
is  proven  that,  imder  only  mild  restrictions  on  the  original  function  /,  they  can  be 
used  to  construct  a  sequence  of  approximations  that  converge  exponentially  to  /  in 
the  maximum  norm.  The  results  of  the  theorems  of  section  5  are  illustrated  by  three 
more  examples  in  section  6.  We  discuss  our  results  in  the  final  section  and  compare  our 
approximations  with  those  used  by  other  investigators. 

2.  Basis  functions  Fo  and  ^i.  Consider  the  27r-periodic  functions 

.  ^  1  sinfa:)  ,  ^  x  1  TT 

(1)  So{x)  =  ,  ^  /  -  and  5i(a;)  = 

2v2  y'l  —  cos(x)  V^ 

which  are  illustrated  in  Figure  1.  Using  the  Taylor  series  expansions  of  sin(x)  and  cos(a;) 
about  X  =  0,  it  is  straightforward  to  show  that 

(2)  +  =  +  asx^O. 

From  these  relations  it  follows  that  Sq  and  Si  satisfy  the  following  jump  conditions  at 

X  =  0  ; 

(3)  [So(0)l  =  l,  ^(0)  =0,  [S.(0)|  =  0,  ^(0)  =1. 

Here  we  have  used  the  notation  [g(x)]  =  g{x+)  -  g{x-).  (In  the  second  and  fourth 
equations  in  (3),  the  derivatives  of  Sj  are  understood  to  be  derivatives  “from  the  right” 
and  “from  the  left”,  respectively.)  We  also  note  that  both  Sq  and  Si  have  continuous 
derivatives  of  all  orders  for  —  tt  <  x  <  0  and  0  <  x  <  tt. 

Consider  now  the  problem  of  approximating  the  piece-wise  continuoiis  (smooth) 
27r-periodic  function  /(x),  which  can  be  represented  at  points  of  continuity  of  /  by  its 
Fourier  series,  i.e.. 


fix)  =  lim  F^^\x) 

N-^oo 


Oq 

~2 


N 

Oj  cos(jx)  -I-  bj  sin(jx), 
t=i 


cos(jx)  \ 
sin(jx)  J 
2 


(4) 


dx,  j  =  0, 1, ...  . 


We  shall  assume  that  f{x)  and/or  f'{x)  may  have  discontinuities  at  a  finite  number 
of  points,  say  at  x  =  Xj,  j  =  1,2,  ...,n,  in  the  interval  (— tt,  tt],  and  that  the  one-sided 
limits  of  /  and  f  exist  and  are  finite  at  each  of  these  points. 

To  construct  a  more  rapidly  converging  Fourier  series  type  representation  of  /,  we 
first  define  the  function 

n 

(5)  Ri{^)  =  ~  ^j)  —  Xj)}  , 

where  the  constants  {^oj}  cind  are  determined  so  that  the  jumps  in  Ri(x) 

and  its  derivative  coincide  with  the  corresponding  jumps  in  /(x).  Using  the  relations 
(3),  this  requirement  leads  to  the  expressions 

(6)  Aoj  —  [f{xj)] ,  Aij  =  [/  (xj)] ,  J  =  1,  2,  ...n. 


Then  we  write 


(7)  /(x)  =  Ri{x)  /i(x),  where  /i(x)  ==  /(x)  -  fii(x). 

By  the  way  it  has  been  defined,  the  function  /i(x)  is  C^[-7r,7r]  (at  least)  and,  hence, 
its  Fourier  series  wiU  converge  at  a  faster  rate  than  the  Fourier  series  of  /.  To  construct 


its  Fourier  series,  we 

(8)  So{x)  = 


first  note  that  So  and  can  be  expanded  in  a  Fourier  series  as 


^o,i  -  - 


TT  Ap  —  1  ’ 


and 

(9)  Si{x)  =  I-  cos(x)  =  -^  +  oij  cos(7x) ,  ■ 

Then,  denoting  the  Fourier  coefficients  of  /i  by  we  find,  using  equations 

(4)-(9), 

n 

af^  =  %  -  {Ai,sai,j  cos{jXs)  -  sin(7x,)}  , 


(10)  =  sin(jx,)  +  A.sVj  cos(;x3)}  ,  j  =  1,  2, ...  . 

S  =  1 

As  we  shaU  demonstrate  explicitly  in  the  next  sections,  the  coefficients  {oj  \  b^j  decay 
faster  (by  at  least  a  factor  of  l/p')  as  j  — >  oo  than  the  original  Fourier  coefficients 
{aj,  bj}.  Using  these  definitions,  we  define  the  new  approximations 

(1)  N 

(11)  =  Ri{x)  ^  cos(jx)  +  bf'>  sin(jx),  >  0. 

^  i=i 
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These  functions  are  the  first  in  a  sequence  of  “better”  approximations  to  /,  which  we 
shall  illustrate,  generalize,  and  then  analyze  and  discuss  in  the  following  sections.  (We 
note  that  the  general  idea  of  “subtracting”  from  the  Fourier  series  of  /  the  Fourier  series 
of  another  “simple”  function  with  an  appropriate  singularity  has  been  considered  by 
other  investigators,  for  example,  by  Tolstov  [13],  pp.  144-147.  However,  this  idea  does 
not  seem  to  have  been  pursued  in  any  systematic  or  exhaustive  manner.) 

3.  Examples.  Before  we  generalize  the  family  of  approximations  and 

discuss  some  of  their  convergence  properties,  we  illustrate  these  approximations  by  two 
examples. 

Example  1:  We  consider  first  the  function  f{x)  defined  by  f{x)  =  x  +  n,  for 
-TT  <  X  <  0,  f{x)  =  X  -  TT,  for  0  <  X  <  TT,  and  /(x  4-  27t)  =  /(x),  for  all  x.  Then 
X  =  0  is  the  only  point  of  discontinuity  of  /(x)  in  the  interval  -tt  <  x  <  tt.  Thus,  we 
set  n  =  1  with  Xi  =  0  in  equation  (5)  above  and  use  the  facts  that  [/(O)]  =  -2%  and 
[J'(0)]  =  0  in  equations  (6)  to  define 

^  ,  tt  sin(x) 

(12)  7?i(x)  =  Ao^iSo{x)  +  Hi_i5i(x)  =  ,  - — —  ■ 

wl  —  cos(x) 

Thus,  Ri{x)  has  the  same  jump  at  x  =  0  as  the  function  /(x),  which  is  clearly  evident 
in  Figrue  2,  where  we  have  plotted  both  /(x)  and  Ri{x).  Hence,  we  now  consider  the 
function  /i(x)  =  /(x)  -  i?i(x),  which  is  C^[-7r,  tt],  and  is  also  shown  in  Figure  2.  Using 
equations  (10),  we  expand  /i(x)  in  a  Fourier  series  as 

/  2 

(13)  f,(x)  =  ^bfhm{jx),  fcf  = 

We  note  that  the  coefficients  are  0{l/f)  as  j  oo,  while  the  Foiuier  coefficients 
bj  =  -2/j  of  /  are  only  0{l/j)  as  j  — >■  oo.  Then,  using  equation  (13)  in  equation  (11), 
we  define  the  approximations 

(14)  =  Ri(x)  +  '^b^^^sin(jx). 


In  Figure  3  we  have  plotted  both  /(x)  and  /U>3)(x),  where  the  good  agreement  is 
evident. 

Example  2:  As  a  somewhat  more  complicated  example,  we  consider  the  function 
/  defined  by 


-(x  +  7r/3), 
2x, 

1, 

(x  —  7r/2)~  +  1/2, 


-TT  <  X  <  — '7r/3, 
— 7r/3  <  X  <  0, 

0  <  X  <  7r/2, 
7r/2  <  X  <  TT, 


and  f(x  +  27r)  =  f{x)  for  all  x.  This  function  is  illustrated  in  Figure  4,  along  with  the 
Fourier  series  partial  sums  F^^^x)  of  /(x),  defined  by  equations  (4),  for  N  =  10,  and 
the  error  (difference)  /(x)  —  F^^°^(x). 
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The  function  /  has  discontinuities  at  the  n  =  4  points  Xi  =  — tt/S,  X2  =  0,  X3  =  7r/2, 
and  X4  =  TT.  Using  the  definition  (15)  and  the  relations  (6),  we  find  that  the  coefficients 
{2loj}  and  {^ij}  in  the  definition  (5)  of  Ri{x)  are  given  in  Table  I. 


Table  I:  Coefiicients  Akj  for  Example  1. 


j 

Aij 

1 

-27r/3 

3 

2 

1 

-2 

3 

-1/2 

0 

4 

(Stt  —  6  —  37r^)/12 

-(1  +  7r) 

The  frmctions  f{x) ,  i?i  (a:) ,  as  well  as  the  difference  /i  (x)  =  f{x)-  Ri  (x) ,  are  shown 
in  Figure  5.  Obviously,  fi{x)  is  much  smoother  than  /(x),  and  in  fact,  the  three-term 
Fourier  series  partial  sum  of  /i(x)  is  virtually  “identical”  to  /i(x),  to  within  plotting 
accuracy.  Thus,  the  approximation  which  is  shown  in  Figure  6  along  with  / (x), 

is  a  much  better  approximation  to  /(x)  than  the  original  Fourier  series  representation 
of  /,  even  when  many  more  terms  are  included  in  F^^\x)  (cp.  Figure  4). 

4.  Generalizations.  The  basis  functions  introduced  in  the  section  2  can  be  gen¬ 
eralized  and  extended  to  allow  us  to  construct  functions  which  have  appropriate  dis¬ 
continuities  at,  say,  the  derivative.  To  this  end,  we  define  the  functions  Sn{x)  by 

2fe-3/2 

S2k{x)  =  sin(x)  (1  -  cos(x))  , 


9fc-l/2 

(16)  S2k+i{x)  =  -  (1  -  cos(x))  ,  fc  =  0,1,2,.... 

Then  it  is  straightforward  to  show  that  iS'„(x)  is  tt,  tt],  while  the  jump  in  its  nF 

derivative  at  x  =  0  is  1.  More  generally,  each  has  continuous  derivatives  of  all  orders 
for  -TT  <  X  <  0  and  0  <  x  <  tt,  and,  at  x  =  0,  satisfies  the  jump  conditions 


^dx) 


=  0,  if  g  <  n; 


c=0 


5f^-*-i)(0)]  =  [4'^HO)]  =  (-1/4)^  p  >  0; 


4Si(0)' 


=  0,  p  >  fc  >  1, 


q(2p+1) 

‘^2fc+l 


4f{0)] 

(-1)P+^  /2p\ 

-  1)  Vj) 


(-1)’  [d?-2(o)]  ,p>k>i. 


(17) 


In  particular,  specific  values  for  the  jumps  of  are  summarized  in  Table  II  for 

a  few  small  values  of  k  and  p. 


Table  II:  The  jumps 


Using  the  definitions  (16),  we  find  that  the  Fourier  series  of  Sn  can  be  expressed  as 

(18)  S2k+i{x)  =  +  E  «2fc+i.i  cos(jx),  S2k{x)  =  Y1  ^2fcj  sin(ja;), 

^  j=i  1=1 

4^+1  1 

^  _  (  I'lfc+iZ _ z _ 

a2k+i,j  —  K~^)^k  ’ 

u{4f-{2i+m 

i=0 

(19)  —  j^2k+l,j  5  j  0)  f)2,  , 

for  k  =  0, 1,2, ...  .  (For  convenience  in  certain  formulas  which  follow,  we  also  define 
a2k,j  =  hk+ij  =  0,  for  k  >  0.) 

Now  let  the  27r-periodic  function  /  have  possible  discontinuities  in  f^^'>  for  0  <  fc  < 
M  at  a:  =  Xj,  j  =  1,2,  ...,n,  where  -rr  <  Xj  <  tt.  (Here  we  assume  that  all  of  the 
one-sided  limits  and  f^’^^xj)  exist  and  are  finite.)  We  define  the  function 

M  n 

(20)  Rm{x)  =  ■^k,jSk{x  ~  Xj), 

fc=0 j=l 

where  the  constants  {Akj}  are  determined  so  that  fM{x)  =  f{x)-  Rm{x)  is  C^[-7T,Tr]. 
Using  the  relations  (17),  we  find  that  these  constants  can  be  determined  recursively  from 
the  relations 

(21)  J  =  k  =  0,l,...,M. 

i=0 

Thus,  the  function  fmix)  will  be  C'^[-7r,7r],  at  least,  and  hence  its  Fourier  series  will 
converge  at  a  faster  rate  than  the  Fourier  series  of  /. 
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Once  Rm{x)  has  been  defined,  we  define  the  family  of  approximations  to  / 

by 

(M)  N 

f(^R\x)  =  Rm{x)  +  ^  4^^  cos{jx)  +  Sin(jx), 

^  t=i 

M  n 

=  a^-Y.Y.  {ak,j  cos{jXs)  -  bkj  sin(jx,)}  , 

fc=0  s=l 

M  n 

(22)  bf'^^  =  W,j  sin(;a:,)  +  bk,j  cos{jXs)}  ,  j  =  0, 1, 2, ...  . 

k=0 s=l 

These  approximations  have  several  nice  convergence  properties,  which  we  shall  discuss 
in  the  next  section. 

Returning  to  Example  1,  since  the  fimction  fi{x)  (see  equation  (7))  is  C'^[-'k,tc] 
and  satisfies  the  jump  conditions  [/f(0)]  =  — 7r/2  and  [/"'(O)]  ^  b’  ^he  definition 

of  Rm{'^)  ill  equation  (20)  with  M  =  3  to  define 

R^{x)  =  -2-kSq{x)  -  '^S2{x) 


sin(a:) 


TT 


^/2y^  —  cos(2:)  4\/2 


sin(a;)01  —  cos(x). 


(23) 


Then  fsix)  =  f[x)  -  R^ix)  is  C^f-Tr, tt],  and  the  Fourier  series  coefficients  in  the 
definition  (22)  of  are  given  by 


(24) 


=  0,j>  0;  = 


18 


j(4j2  -  l)(4j2  -  9) 


,  J  >  1- 


We  note  that  bf'^  =  0{l/f)  as  j  ^  oo,  while  the  original  Fourier  coefficients  of  /  are 
only  0{l/j)  as  j  oo. 

5.  Convergence  properties.  We  now  investigate  some  of  the  convergence  prop¬ 
erties  of  the  function  defined  in  the  previous  section,  as  M,  N  >■  oo.  For  this 

purpose,  we  first  define  the  errors 

Ei^^^){x)  =  f{x)-f^^’^\x) 


OO 

(25)  =  ^  cos(jx) -h  sin(jx),  M>0,N>0, 

j=N+l 

where  the  coefficients  {a^^\bf^'>}  are  defined  in  equations  (22).  Since  the  function 

fM{x)  =  f{x)  -  Rm{x)  is  C^[-r(,  tt],  it  follows  that  both  and  are 
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as  j  ^  oo  (see,  e.g.,  [1]).  Thus,  there  exists  a  constant  K  =  K{M,N),  independent  of 
T  such  that 


(26) 


a 


(M) 


< 


K 


3 


M+2  ’ 


I6f  < 


K 

^M+2  ’ 


for  all  j  >  +  1 . 


Using  the  bounds  (26),  we  find  from  equation  (25)  that 


(27) 


X 


~  1  2K 

<2^  E 

j=N+l  J 


1 


M  +  1  ^ 


which  follows  easily  from  the  integral  comparison  test. 
Suppose  now  that  K  satisfies  a  bound  of  the  form 

(28)  K<ke^^MPM\,  as  M,N^oo, 


where  K  and  6  are  constants  independent  of  M  and  N.  Then,  if  we  let  N  be  propor¬ 
tional  to  M,  say,  N  —  AM,  where  A  >  9je,  it  follows  that  the  errors  decay 

exponentially  to  zero  as  M  oo.  To  see  this,  we  substitute  (28)  into  (27)  and  use 
Stirhng’s  approximation  to  the  factorial  to  write 

2K  1  ^  ^  -MP9^  V2^{M/e)^ 

iU+TfV^  -  M  +  l  (AM)^^+1 

(29)  <  ^ 

where  K  is  another  constant,  independent  of  M  and  N,  and  (0/Ae)  <  1.  Thus,  we  have 
proved  the  following  theorem. 

Theorem  1.  Let  f{x)  be  a  piece-wise  smooth,  27i-periodic  function  with  possible 
discontinuities  in  f  and/or  some  of  its  derivatives  at  a  finite  number  of  points  in  the 
interval  — tt  <  x  <  tt.  Suppose  that  the  Fourier  coefficients  defined  by 

equations  (21)-(22)  satisfy  the  inequalities  (26),  where  K  satisfies  the  bound  (28).  Then 
the  approximations  defined  by  equations  (20)- (22)  converge  exponentially  to 

f{x)  in  the  L^  —  norm  as  M  oo,  if  X  is  chosen  so  that  A  >  9/e,  i.e. 

l/(x)  -  (Tj  . 


^(M,V)(^) 


where  K  is  a  constant  independent  of  M. 

To  illustrate  this  theorem,  the  coefficients  {5^^}  for  Example  i  for  M  =  2m  +  1 
are  easily  shown  to  be  given  by 


(30) 


/2m+l) 


(l-3-5---(2m  +  l))2 

7n™o(472-(2*  +  l)")’ 


m  =  0, 1,  2, ...  . 
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Noting  that  1  •  3  •  5  •  •  •  (2m  +  1)  =  (2m  +  l)!/(2™m!),  we  use  Stirhng’s  approximation 
to  the  factorial  in  equation  (30)  to  write 


(31) 


j 


a+l) 


<K^e- 


J 


M+2 


2^a=o(l-((2^  +  l)/2jT)’ 


where  if  is  a  constant  independent  of  j  and  M.  In  the  Appendix  we  show  that  there  is 
another  positive  constant,  K,  such  that 

(32)  9^  <  9o  =  ^o(A)  =  1/  (2^1  -  1/(4A2))  , 


for  all  A  >  A,  where  A  is  any  arbitrary  number  greater  than  1/2,  and  for  all  j  > 
N  +1  =  AM  +  1.  Thus  we  see  that  satisfies  the  bound  (26),  where  K  has  the 

form  of  the  right  side  of  equation  (28)  with  p  =  1/2  and  6  —  0q[\).  (See  the  Appendix, 
also,  for  a  derivation  a  sharper  bound  for  9.)  Then  the  condition  that  A  >  9o/e  leads 
to  the  requirement  that  A  >  Ao  =  \/l  +  e^/2e  =  0.533.  In  Figure  7  we  have  plotted 
the  normalized  errors  M{Xel9o)^E^^’^\x)  as  a  function  of  2:,  with  A  =  1  (and  hence 
iV  =  M)  for  M  =  5,  9,  and  13.  We  note  that  the  error,  when  regarded  as  a  function  of  x, 
is  much  more  uniformly  distributed  over  the  interval  [  7r,7r]  than  is  the  corresponding 
error  for  the  original  Fourier  series,  which  is  highly  concentrated  around  a:  =  0.  In 
Figure  8  we  have  plotted  the  normalized  Loo— errors  M {Xe/ 9q)^ {x)\,  with 
=  AM  as  a  function  of  1/M  for  several  choices  of  A  >  Aq.  The  figure  clearly  illustrates 
that  these  quantities  are  bounded  as  1/M  ^  0  and,  hence,  that  the  errors  E^^’^^x) 
decay  uniformly  and  exponentially  to  zero  as  M  increases. 

To  investigate  the  convergence  properties  of  the  approximations  for  a 

general  function  /,  we  first  consider  the  following  lemma. 

Lemma  1:  Let  f{x)  be  a  27t— periodic  function,  n  a  positive  integer,  and  the  points 
Xq  =  — TT  <  Xi  <  ...  <  Xn  =  re  be  defined  such  that  f{x)  =  Pk{k  ^k-i  <  x  <  Xk,  k  = 

1^2 . n,  where  pk  is  a  polynomial  of  degree  at  most  m.  Then  the  Fourier  coefficients 

of  f  defined  by  equations  (4)  can  be  expressed  as 


a,  =  -  ^  <^  sm{jxfi 

7T  —  '  ' 


/W21 


fc+l 


\  k=0  d 


i2fc+l 


+  cos{jxfi 


,2fc+2 


fc=0 


bj  =  //  cos(jT,)  I  ^ 


/[W21  (_!)#= 


\fc=o  7 


,-2fc+l 


+  sin(jT^) 


[(m-l)/21 


A2k+2 


fc=0 


[/(“+«  (X,) 
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where,  in  the  upper  limits  of  the  inner  summations,  we  have  let  [g]  denote  the  greatest 
integer  not  exceeding  q. 

The  proof  of  this  lemma  follows  easily  by  using  the  formulas  (4)  and  integrating 
each  of  these  expressions  by  parts  m  times  (see,  e.g.,  [10],  pp.  489-493,  for  more  details). 

Inserting  these  expressions  into  equations  (4)  and  rearranging  the  resulting  series, 
we  can  express  the  Fourier  series  of  /  as 


1  n  ^  ^ 

^  (/(^^)  +  =  Y  +  E  E  hk[x 


s=l  k=0 


(33) 


h2k{x) 


{-ir 


oo 


L 


sinjjx) 

j2k+l  ’ 


h2k+i{x) 


OO 


E 


cos(j'x) 

j2k+2  ’ 


for  A:  =  0, 1, ...  .  Hence,  to  estabhsh  the  exponential  convergence  of  our  approximations 
for  a  “piece- wise  polynomial”  function  /,  as  defined  in  Lemma  1,  it  is  sufficient  to 
establish  that  our  approximations  converge  exponentially  to  each  of  the  fimctions  hk{x) 
defined  in  equations  (33).  In  fact,  we  shall  show  that 


(34) 


\ht{x)  - 


<  EM 

-  M  i\ 


z  =  0, 1, ...  , 


and  hence 
(35) 


max  \hi(x)  —  h 

— 7r<x<7r  I 


where  Kq  is  a  constant,  independent  of  M,  =  1/  (2^1  —  l/(4A2)j  ,  with  X  =  N/M, 


and 

M 

N 

(36) 

^  E 

Ap''s,(x) + 

k^2p 
k  ever 

t=i 

i 

M 

(2p+l,M)  N 

(37) 

Cf(^)^  E 

^(2p+l) 

Sk{x)  +  +  ^ 

k=2p-\~\ 
k  odd 

^  j  =  l 

Y^^{2p+l,M)  cos(jx), 


for  p  =  0, 1, ...  .  Here  the  constants  and  as  well  as  the  coefficients 

and  are  determined  as  described  in  section  4. 

To  show  that  equations  (34)-(37)  hold,  we  shall  use  induction.  The  function  ho  = 
(-l/27r)/(x),  where  f{x)  is  the  function  of  Example  1.  Hence,  using  equation  (33)  with 
k  =  0  and  equation  (36)  with  p  =  0,  we  can  write 


(38) 


1  OC 

ho{x)  -  hf^'^\x)  = Y,  hf^sin{jx), 

j=Ar+i 
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where  with  M  =  2Tn  +  1,  is  given  by  the  right  side  of  equation  (30).  Using  the 
bounds  (26)  and  (28),  with  0  =  0o,  P  =  1/2,  and  N  =  AM,  as  well  as  the  remarks  below 
equation  (30)  and  Stirhng’s  approximation  to  the  factorial,  we  can  write 


hQ{x)  -  ho 


{M,N) 


where  Kq  is  another  constant,  independent  of  M.  Hence,  equation  (34)  holds  with  i  =  0 
and  the  exponential  convergence  of  om  approximations  to  ho  is  estabhshed. 

Suppose  now  that  equations  (35)-(37)  hold  for  i  =  0, 1, g  —  1.  To  investigate  the 
behavior  of  we  observe  first  that 

(39)  and  S'^i+iix)  =  S2i{x), 

for  all  nonnegative  integers  i.  (Here  the  primes  denote  differentiation  with  respect  to 
X.)  Then,  using  the  first  relation  in  (39),  with  i  =  g  —  1,  we  can  write 

hq{x)  —  hg(0)  +  f  h'q{t)dt  —  hg(0)  +  /  hq^i{t)dt 
Jo  J  ^ 


(40)  + 

where 

J  0 


(41) 


£:(«.iv)(^)  =  £  dt. 


Using  our  induction  hypothesis  and  equation  (34)  with  t  =  g  —  1,  we  find  from  equations 
(40)  and  (41)  that 


h,(x)  - 


and  hence 
(42) 


rhi  Kq 

L  M(g-l)! 


M  q 


max 

-7r<X<7r 


h,(x)-hf'^-)(x)|<^ 


M  q\ 


Thus,  it  just  remains  to  be  shown  that  defined  in  equations  (41),  has  the 

form  indicated  in  equations  (36)  and  (37).  To  see  that  this  is  the  case,  if  q  is  odd,  we 
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use  equation  (41),  equation  (36)  with  2p  =  q-l,  and  the  last  relation  in  equation  (39) 
to  write 

.j.  I  M  N 

=  hg{0)  +  /  <  E  4"“'^5fc(t)  +  E 

■^0  fc=<,-l  3  =  1 

V  k  even  J 

N  M  N 

=  hgiO)  +  +  E  A^r'^Sk+iix)  +  cos(jx), 

j  =  l  fc=q— 1  3=1 

k  even 

which  has  the  form  of  equation  (37)  with  2p+l  =  q,  where 

2 |a,(0)  +  X;(1/j)6<’-‘’'“> I  . 

(43)  4’’=41K’.  af'">  = 

If  q  is  even^  we  use  equation  (41),  equation  (37)  with  2p  +  1  =  g  —  1,  and  the  fact 
that  hg(0)  =  0,  to  write 


/if’^)(x) 


E  A[^~^^Sk{t)  +  -^ —  +  E«?  ’  ^cos{jt)\dt 


k=q—l 
k  odd 


3=1 


N 


(44) 


=  h,{x)  +  Y,(\/j)a‘f  ‘'"’sm(ji), 


j=i 


(45) 


M  i-x 

h,{x)  s  x:  4’-“'  /  st(t)dt + 

; _ _  1  *^0 


k=q—\ 
k  odd 


We  now  make  some  observations  concerning  the  frmction  hg.  First,  we  note  that  hg  is 
an  odd  ftmction  of  x,  with  hg(7r)  =  hg{-7i)  =  0.  The  fact  that  hg  is  odd  follows  directly 
from  equation  (45)  and  the  fact  that  each  Sk  is  an  even  function  of  x  whenever  the 
index  k  is  odd.  To  see  that  hg  vanishes  at  x  =  tt,  we  note  first  that,  by  letting  N  oo 
in  equation  (37)  with  2p  +  1  =  g  -  1,  we  can  write 


hq-i(x) 


M 

E  AE^^-Sfc(x)  + 

k=q—l 
k  odd 


Jg-iM) 

“o 


2 


3=1 


cos(jx). 
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Integrating  this  expression  from  a:  =  0  to  a:  =  tt  and  using  the  definition  of  hg_i 
(equation  (33)),  we  find 

{q—\,M)  M  ^TT 

(46)  ■  =  -  E  4’^“’  L 

^  7  1  »/  U 

k=q—l 
k  odd 

Setting  X  =  TT  in  equation  (45)  and  then  using  equation  (46),  we  find  that  hg_i(7r)  =  0. 
Using  this  first  observation,  we  note  next  that  hg-i  has  g  -  1  continuous  derivatives  for 
-TT  <  X  <  TT,  and  that  the  only  discontinuities  in  higher  (even)  order  derivatives  occur 
at  X  =  0.  Thus,  using  the  ideas  of  section  4,  we  can  write 

M  oo 

(47)  hg-i{x)=  ^kSkix)  +  ^b)^hm{jx), 

k=q  a=l 

k  even 


where  the  constants  Ak  are  determined  recursively  by 


A,  =  E  4''“’  [4"'’(o) 

k=q—l 
k  odd 


j-2 

Ak  [4^^(0)]  >  q<j<M,j  even, 

k=q 
k  even 


and  the  coefficients  are  determined  by  the  right  side  of  the  last  equation  in  (22), 
with  Xs  =  0,  Ak,s  —  Ak,  and 


M  \ 

E  4’- Vo + 4'“'’"’ 

k=q-l  j 

\  k  odd  / 


+  E  4“-”^. 

k=q—l  ^ 

k  odd 


Thus,  when  the  right  side  of  equation  (47),  with  the  upper  hmit  of  the  second  summation 
replaced  by  N,  is  substituted  for  hg_i{x)  in  equation  (44),  we  see  that  has  exactly 

the  form  of  the  right  side  of  equation  (36)  with  2p  =  q. 

We  now  summarize  these  results  in  the  following  theorem. 

Theorem  2.  Let  f  be  a  2ii -periodic,  “piece-wise  polynomial”  function,  as  defined 
in  Lemma  1.  Then  the  sequence  of  approximations  /(^-^^)  defined  in  section  4  converge 
exponentially  to  /,  with 


max 

-7r<x<7r 


/(x)-/<«“4)|<4  ^ 


M 


where 


n  m 

/("■''|(x)^|  +  EE[/(‘)(V 


hi"’"* 


(x 


Xo 


S=1  fc=0 


and  K  IS  a  constant  (which  depends  on  the  particular  function  f,  but  is  independent  of 
M)  such  that 


^oEEil-f^’fv 
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s=l  fc=0 


TT  ~ 


where  Kq  is  the  constant  which  appears  in  the  bounds  (35). 

Finally,  we  consider  the  case  when  f{x)  is  a  27r— periodic,  piece-wise  analytic  func¬ 
tion.  We  let  the  n  points  xq  =  —it  <  Xi  <  ...  <  Xn  =  tt  be  defined  such  that 
/(x)  =  /j(x)  for  <.x  <Xi,i  =  1,2,  ...,r?,,  where  each  fi{x)  is  analytic  on  the  closed 
interval  Xi_i  <  x  <  x,,  and  such  that  there  exists  a  point  a^,  with  Xi_i  <  ai  <  x^,  such 
that  (xj  -  Xj_i)  <  Pi,  where  pi  is  the  distance  between  ai  and  the  nearest  singularity  of 
/j  in  the  real  or  complex  plane.  Then,  by  Taylor’s  theorem,  we  can  write 


j=0  -  d-  j=m+l  ■! ' 


We  now  assume  (see,  e.g.,  [9])  that 
(49) 


#(«.)<  1  <*<"., 
A 


where  Ci  is  a  constant,  independent  of  j  and  pi.  Using  equations  (48)  and  (49),  we  can 
write 

771+1 


(50)  max  \fi{x)  -  Pi^m{x)\  =  max  \Ri,m{x)\  <  Q 

Xi-l<X<Xi  Xi-l<X<Xi 


Xj  -  X;_i 

Pi 


where  Ci  =  Cipi/{pi  -  x^  +  a^)  and  (x^  -  Xi_i)/pi  <  1,  from  our  definition  of  the  points 
{xj}.  We  now  define 


(51) 


C  =  max  Ci, 

\<i<n 


77  =  max 

l<i<7i 


<  1, 


so  that  from  equations  (50)  and  (51)  we  can  write 
(52)  max  \fi{x)  -  Pi,m{x)\  < 

Xi  —  l<X<Xi 

We  now  define  g{x)  as  the  27r-periodic,  piece- wise  polynomial  function  with  g(x)  = 
Pi^m{x)  for  Xi_i  <  X  <  Xi,  7  =  1,2,  ...,77,  and  also  define  the  approximation 


^  S=1  fc=:0 


where  hi^’^\x)  is  defined  in  equations  (36)-(37).  Using  Theorem  2  and  equations  (33) 
and  (35),  we  see  that 


g{x)  - 


n  m 

^  ^  S  I  {hk{ 


X  -  Xc 


(M,AM) 


(x 


X, 


s=l  k=0 
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(53) 


M 


s=l  k=0 


We  now  assume  that  the  jumps  in  /(*=)  satisfy  a  bound  of  the  form 
(54)  s  =  l,2,...,r7,, 

where  A  and  ^  are  positive  constants,  independent  of  k  and  s.  (Here  we  may  assume, 
without  loss  of  generahty,  that  {tt  >  1.)  Since  the  jumps  in  are  arbitrarily  close  to 
the  corresponding  jumps  in  ,  we  assume  that  equation  (54)  also  holds  for  the  jumps 
in  ,  and  then  use  this  bound  in  equation  (53)  to  write 


(55) 


max 

7r<x<7r 


Ko  ({nQ 


,m4-l 


1' 


TT^  —  1 

We  now  combine  the  bounds  (52)  and  (55)  to  write 

fix 


eX 


M 


max 

-7r<x<7r 


_  \fix)  -  9ix)\+  max  g{x) 

^  ^  — TT^X^TT 


x)\ 


(56) 


1 


A' 

eX 


M 


We  now  set  m  =  M  in  equation  (56)  and  note  that  the  second  term  in  equation  (56) 
is  dominated,  for  large  values  of  M,  by  a  constant  times  C^,  where  C  =  7r^0o/eA. 
Since  we  want  the  magnitude  of  this  quantity  to  be  less  than  1 ,  we  must  require  that 
A  >  fy?”+47r^/2e.  Then,  with  this  stipulation,  we  find  from  equation  (56)  that 


(57) 


max 

— 7r<x<7r 


K2 


fix)  -  as  M 


oo, 


where  Ki  and  K2  are  constants,  independent  of  M,  while  0<7/<land0<C- 
TT^Oo/eX  <  1.  Thus,  we  have  proved  the  following  theorem. 

Theorem  3.  Let  f  be  a  27r-periodic,  “piece-wise  unalytic  function,  ns  defined 
above.  Then,  for  X  >  /2e,  the  sequence  of  approximations  f(^LM)  (defined 

in  section  4  converge  exponentially  to  /,  i.e., 


max 

-7r<x<7r 


fix)~f^^’^^\x)\<Kip^-\-^C,^-,  where  C,  = -Kfeo/ eX  <  1. 


Here  Ki  and  K2  are  constants,  independent  of  M,  g  is  related  to  the  lengths  of  the 
intervals  [xi-i,Xi]  and  the  singularities  of  fi  (see  equation  (51)),  ^  is  related  to  the 
jumps  in  the  derivatives  of  f  (see  equation  (54)),  and  Oq  =  1/  {2^1  -  l/(4A2)j  . 

Before  we  illustrate  the  results  of  this  theorem,  we  make  two  observations.  First,  if 
the  jumps  (xjj  satisfy  a  bound  of  the  form  of  (54)  and  ^vr  <  1,  then  it  follows  that 
Theorem  3  holds  with  f  —  Oq/cX.  (This  conclusion  follows  from  the  estimates  derived 
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above  and  the  fact  that  — >■  0,  as  M  — >  oo.)  Secondly,  we  observe  that  if  the 

jumps  in  satisfy  a  bound  of  the  form  |  i.e.,  of  the  form  of  equation 

(54),  but  without  the  factor  k\  present,  then,  again,  THEOREM  3  holds  with  C,  =  Oq/cX. 
(This  follows  from  theTact  that,  for  this  case,  the  “fc— summation”  in  equation  (53)  is 
bounded  by  a  constant  times  exp(7r^),  as  m  =  M  — >  oo.) 

We  now  summarize  these  observations  in  the  following  corollary. 

Corollary  4.  If  the  jumps  satisfy  a  bound  of  the  form  of  (54)  and 

fn  <  1,  or  if  they  satisfy  a  bound  of  the  form  s  =  1,2,  ...n,  where 

A  and  are  positive  constants,  independent  of  k  and  s,  then  the  results  of  Theorem 
3  hold  with  (  =  Oq/cX.  In  either  of  these  cases,  f  will  be  strictly  less  than  one  if 
X  >  (l/2e)Vl  +  e2  =  0.533. 

6.  More  examples.  In  this  section  we  consider  three  examples  which  serve  to 
illustrate  some  of  the  convergence  properties  discussed  in  the  previous  section. 

Example  3:  Let  a;  be  a  non-integer  constant  and  define  f{x)  =  cos{cl!{x  —  tt))  , 
for  —71  <  X  <  77,  and  f{x  +  27r)  =  f{x)  for  all  x.  We  note  that,  since  the  cosine  function 
is  analytic  in  the  entire  finite  part  of  the  complex  plane,  the  only  singularities  in  /  arise 
from  the  fact  that  cos  {u{x  —  tt))  is  not  27t— periodic.  In  this  case,  we  set  n  =  1,  with 
Xq  =  — TT  and  Xi  =  tt.  Then  the  quantity  rj  in  equation  (52)  can  be  made  arbitrarily  small 
and,  hence,  the  convergence  of  our  approximations  is  dominated  by  the  second  term  on 
the  right  side  of  equation  (57).  Also,  for  A:  =  0, 1, 2, ...,  f^^'>  has  only  one  singularity  in 
the  interval  (-7r,7r]  and  this  singularity  lies  at  x  =  tt,  with  the  corresponding  jumps 
given  by 


/“’w'  = 


(_l)i+A:/2^fc  _  cos(2c<;7r)) ,  if  A:  is  even, 

(_l)(^-i)/2^fc  sin(2c<;7r),  if  k  is  odd. 


Thus,  the  jumps  in  satisfy  a  boxmd  of  the  form  specified  in  equation  (54)  with 
^  =  iu,  but  without  the  factor  of  A:!.  Thus,  if  follows  from  Corollary  4  that  orrr 
approximations  converge  exponentially  to  /  at  a  rate  which  is  bounded  by  C  =  do/eX. 
The  Fourier  coefiicients  of  /  are  given  by 


(— l)-^^^Ci;sin(2a;7r) 

7r(j2  _  ^2) 


(_l)t+ij(l  _  cos(2a;7r)) 

7r(j2  _  (^2) 


while  the  coefficients  a\^’  and  b)  are  defined  by 


(0)  _  (2fc+i)  _  (2fc+2)  ^  (-l)^+^a;sin(2a;7r)  ^  ( 4u7^  -  (2z  +  1)^ 

7r(f-a;2)  U  4^2  _  (2^  +  1)2 


,  i2k+i)  ^  -  cos(2u;7r)) 

7r(j2  -  a;2) 


n 
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for  k  =  0, 1,  2, ...  .  Following  the  same  arguments  given  in  section  5,  we  find  for  this 
example, 


^  ~  M  \\e ) 


M  yieJX^  -  1/4 


In  Figure  9  we  have  plotted  the  normalized  errors  M  {2e^\^  —  1/4^  for 

A  =  1  and  several  values  of  M,  for  the  representative  case  when  lj  =  7/5.  In  Figure  10 

we  have  plotted  the  normahzed  Loo— errors  ^  ~  V^)  as  a 

function  of  M  for  several  values  of  A,  also  for  uj  =  7 jh.  We  shall  discuss  these  results  in 
section  7. 

Example  4:  We  let  e  be  a  positive  constant  and  define  f{x)  =  \/{x^  +  e^),  for 
-TT  <  x  <  TT,  and  f{x  +  27r)  =  /(a;),  for  all  x.  For  this  example,  /  has  singularities  in 
the  complex  plane  at  rr  =  ±te,  which  he  “close  to”  the  interval  [-7r,7r],  if  e  is  small. 
Following  the  remarks  before  Theorem  3,  for  this  example  we  set  n  =  2  and  define 
xq  =  — TT,  xi  —  0,  and  X2  =  tt.  Then  we  can  select  cti  =  —it  and  a2  =  T^  and  find 


TT 


In  addition,  each  f^^\x)  has  a  singularity  in  the  interval  (-tt,  tt],  which  lies  at  x  =  2:2  = 
TT,  with  the  corresponding  jumps  given  by 


9jL|  (^-l)/2  .  /  fc  +  1 

=  (7r2  +  e2)^+i  §  V2i  +  1 


+  e2)'=+i 


fin  (^(A:  +  l)tan  ^(e/7r))  ,  fc  odd. 


and  =  0,  if  A:  is  even.  Using  the  fact  that  |sin(z)|  <  1  for  all  real  values  of  z, 

it  follows  from  equation  (66)  that 


(63) 


for  all  values  of  k.  Thus,  the  jumps  in  satisfy  a  bound  of  the  form  specified  in 
equation  (54),  with  A  =  2/(efy7r2  +  e^)  and  ^  =  (tt^  +  Since  <  1  for  any 

real  value  of  e,  it  follows  from  Corollary  4  that  our  approximations  again  converge 
exponentially  to  /  at  a  rate  bounded  by  the  right  side  of  equation  (57),  with  7]  given  by 
equation  (61)  and  C  =  do/eX.  Thus,  for  “small”  values  of  e,  the  rate  of  convergence  is 
dominated  by  the  value  of  77,  while  for  “large”  values  of  e  it  is  dominated  by  the  value 

of  C- 

To  illustrate  the  rate  of  convergence  of  our  approximations  for  this  example,  in 
Figure  11  we  have  plotted  the  quantities 

(64)  Cm  -  [(max  |£<“.“)(x)|)  /  (max 
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as  a  function  of  1/M  for  A  =  1  and  various  values  of  e  between  0.1  and  2.  As  M  ^  oo, 
Qm  approaches  the  asymptotic  rate  of  convergence  of  our  approximations.  For  the 
“smaU”  value  of  e  =  0.1,  the  asymptotic  rate  of  convergence  t]  =  tt/x/tt^  +  e2  =  0.999 
is  indicated  by  the  short  dotted  line  near  Cm  =  1,  while  for  the  “large”  value  of  e  =  2, 
the  asymptotic  rate  C  =  Oo/eX  =  0.212  is  also  indicated  by  a  short  dotted  line.  We  note 
that,  in  both  of  these  “extreme”  cases,  the  figure  seems  to  indicate  that  the  estimate  of 
the  rate  of  convergence  predicted  by  the  theory  is  overly  conservative,  with  the  actual 
rate  of  convergence  being  smaller  (better)  in  each  case  than  the  theory  predicts.  We 
shall  discuss  this  example  further  in  the  next  section. 

Example  5:  Finally,  let  e  be  a  real,  positive  number  and  define  the  function 
f(^x)  =  ((tt  +  e)2  -  ,  for  -TT  <  X  <  tt,  and  f{x  +  27r)  =  f{x),  for  all  x.  For  this 

example,  /  has  singularities  at  x  =  ±(7r  +  e),  which  lie  “close  to”  the  interval  [-7r,7r], 
if  e  is  small.  For  this  example,  we  set  n  =  1  and  define  xo  =  — tt  and  Xi  =  tt,  and  also 
set  ai  =  0.  Then 

TT 


In  addition,  each  /^^^(x)  has  a  singularity  in  the  interval  (— tt,  tt],  which  hes  at  x  —  — 

TT,  with  the  corresponding  jumps  given  by 


2k\ 


(66) 


{ei27r  +  e)y^^  WJ  +  1 
Ad  f  1  1  1 


TT 


+  e  \  (27r  +  e)'=+i  j  ’ 


k  odd, 


and 


(67) 


=  0,  if  A  is  even.  Using  equation  (66),  we  find 


en  \ej 


and,  hence,  the  bound  (54)  holds  with  ^  Thus,  for  this  example,  since  >  1 

when  e  <  TT,  THEOREM  3  guarantees  exponential  convergence  only  for  A  >  x/e^  +  47r2^^/2e 
Ti/ee  =  1.1557/e,  as  e  0.  Alternatively,  for  a  fixed  value  of  A,  the  requirement  that 
C  <  1  will  be  satisfied  only  if  e  >  eo  =  7r/(eyA2'— T/4),  with  Cq  =  1.335  when  A  =  1. 

To  illustrate  the  rate  of  convergence  of  om  approximations  for  this  example,  in 
Figure  12  we  have  plotted  the  quantities  Cm  defined  by  equation  (64)  as  a  function 
of  1/M  for  A  =  1  and  e  =  0.25,  0.375,  0.5,  and  1.  As  M  oo,  Cm  approaches  the 
asymptotic  rate  of  convergence  of  om  approximations.  It  is  obvious  from  the  plot  that 
the  lower  bound  on  e  obtained  above  (eo  =  1.335)  is  too  conservative,  with  the  actual 
value  of  eo  being  closer  to  0.4  (for  A  =  1).  We  shall  discuss  these  results  further  in  the 
next  section. 


7.  Discussion  and  Conclusions.  We  now  make  some  observations  concerning 
the  convergence  properties  of  the  approximations  we  have  constructed,  particularly  in 
light  of  the  examples  we  have  considered. 
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For  the  function  of  Example  1,  each  Fourier  coefficient  is  just  a  monomial  in  (1/j), 
i.e.,  bj  =  —2lj.  In  fact,  this  function  is  just  a  constant  multiple  of  the  function  ho, 
which  was  the  basic  “building  block”  for  the  convergence  proofs  of  section  5.  In  this 
case,  explicit  expressions  for  the  Fourier  coefficients  (equation  (30))  were  obtained, 
where  their  behavior  is  evident.  Since  =  0,  for  k>2,  the  “need”  to 

include  the  basis  functions  Sk  with  fc  >  2  in  the  expressions  for  Rk  is  due  solely  to  the 
jump  in  the  derivative  of  Si,  for  I  <  k  (see,  e.g.,  equation  (23)).  This  observation 
suggests  that  it  might  be  worthwhile  to  try  to  construct  a  new  set  of  basis  functions,  say, 

,  which  have  the  property  that  Sk  has  a  jump  in  only  its  derivative  at  a;  =  0. 

Such  functions  can  be  constructed  in  a  straightforward  maimer,  by  expressing  Sk  as  an 
infinite  linear  combination  of  the  Si,  with  I  >  k.  However,  this  series  representation  of 
Sk  fails  to  converge  for  all  x  in  the  range  — tt  <  x  <Tr,  and  hence  is  not  useful.  Even  if 
these  expressions  for  Sk  did  converge  over  the  entire  interval,  it  is  not  clear  that  they 
would  have  any  practical  advantage  over  the  functions  {Sk}  which  we  have  introduced. 

The  frmction  of  Example  2  is  a  piece- wise  polynomial  function,  as  defined  in  Lemma 
1,  with  m  =  2,  and  has  n  =  4  points  of  singularity  in  the  interval  -n  <  x  <  tt. 
Consequently,  each  of  its  Fourier  coefficients  is  a  polynomial  in  (l/j).  Even  though 
this  function  has  multiple  singularities,  the  approximations  we  constructed  are  able  to 
handle  them  in  a  straightforward  manner. 

Each  Fourier  coefficient  of  the  function  of  Example  3  can  be  expressed  as  an  infinite 
series  in  powers  of  (l/j).  However,  the  construction  of  our  sequence  of  exponentially 
convergent  approximations  follows  exactly  the  procedure  as  in  the  polynomial  case.  In 
fact,  the  only  technical  difference  is  the  inclusion  of  the  jump  in  in  the  definition 
of  the  constants  -A-kj  (see  equation  (21)).  For  this  example,  the  function  /  is  an  entire 
frmction,  with  no  singularities  in  the  finite  part  of  the  complex  x -plane.  In  particular, 
it  is  analytic  on  [— 7r,7r],  but  is  nof  27r— periodic.  Consequently,  the  only  “singularities” 
in  the  27r— periodic  extension  of  /  occur  at  x  —  tt.  Because  of  these  properties,  the 
rate  of  convergence  of  our  approximations  for  this  example  is  the  same  as  the  rate  of 
convergence  for  the  function  Iiq,  i.e.,  f  =  6o/eX. 

Each  Fourier  coefficient  of  the  function  /  of  Example  4  is  again  an  infinite  series  in 
{l/j),  although  these  coefficients  must  now  be  computed  numerically.  As  in  Example 
3,  /  is  analytic  at  each  value  of  x  in  the  interval  [-7r,7r],  but  it  is  not  27r-periodic. 
However,  for  this  case,  /  has  (purely  imaginary)  singularities  in  the  finite  part  of  the 
complex  plane  at  x  =  ±ie.  As  a  consequence,  the  rate  of  convergence  of  the  approxima¬ 
tions  depends  upon  the  value  of  e,  with  the  rate  of  convergence  approaching  1  as  e  0. 
However,  as  e  — >  oo,  the  rate  of  convergence  is  again  the  same  as  that  for  the  function 
ho-  Also,  for  any  real,  positive  value  of  e,  the  approximations  converge  exponentially  for 
any  value  of  A  >  Aq  =  (l/2e)\/l  +  • 

The  function  of  Example  5  is  also  analytic  on  [— tt,  tt],  but,  again,  is  not  27r-periodic. 
In  this  case,  however,  /  has  real  singularities  at  x  =  ±(7r-f  e),  and  the  rate  of  convergence 
of  our  approximations  again  depends  upon  e.  In  this  case,  however,  for  sufficiently  small 
values  of  e  the  value  of  A  must  be  greater  than  a  specific  lower  bound,  which  depends 
upon  e  and  which  increases  as  e  ^  0,  in  order  to  ensure  exponential  convergence. 
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In  comparing  the  results  of  Examples  4  and  5,  we  note  that,  in  both  cases,  there  are 
singularities  of  /  which  he  a  distance  e  from  the  interval  [— 7r,7r].  In  Example  5,  when 
e  is  “small” ,  these  singularities  lie  close  to  the  points  where  the  27r-periodic  extension 
of  /  has  real  singularities,  namely,  at  x  =  ±7r.  In  this  case,  the  presence  of  these  “near¬ 
by”  singularities  seems  to  adversely  affect  the  convergence  of  our  approximations,  in 
the  sense  that  we  are  forced  to  require  that  A  increase  as  e  decreases.  By  contrast,  in 
Example  4  the  singularities  lie  “far”  from  the  points  where  the  27r-periodic  extension 
of  /  has  real  singularities,  even  when  e  is  small.  In  this  case,  although  the  rate  of 
convergence  is  affected  by  the  value  of  e  through  the  parameter  77,  it  is  not  necessary  to 
require  that  A  increase  as  e  becomes  smaller.  Thus,  the  “nearness”  of  the  singularities 
of  /  to  the  points  {xj}  seems  to  be  of  more  significance  than  simply  the  nearness  of  the 
singularities  to  the  interval  [— tt,  tt]  . 

In  the  formulas  above,  we  have  consistently  used  (because  of  its  simphcity)  the 
simple  (loose)  bound  60  in  our  estimates  of  the  rates  of  convergence  of  our  approxi¬ 
mations.  These  estimates  could  be  improved  somewhat  by  using  instead  the  sharper 
estimate  derived  in  the  Appendix.  For  example,  the  plots  in  Figure  8  of  the  L^-enors 
for  Example  1,  which  were  normalized  using  ^0,  clearly  show,  by  the  downward  trends 
as  M  — >  00,  that  the  actual  rate  of  convergence  is  smaller  than  the  rate  9o/Xe  which 
was  used  in  the  normalization.  In  Figure  13,  we  have  plotted  the  maximum  {L^) 
errors  max  for  Example  1,  normalized  by  M{Xe/Do9o)^ ,  which  involves 

the  sharper  error  bound  derived  in  the  Appendix,  where  Dq  is  defined  by  equation 
(73).  Each  of  these  plots  are  clearly  boimded  as  M  becomes  large,  and  appear  to  be 
approximately  hnear  as  M  — >  00,  with  a  slope  that  approaches  zero  as  A  becomes 
large.  These  observations  are  consistent  with  an  asymptotic  rate  of  convergence  given 
by  E>o^o/Ae  <  9^1X6. 

As  mentioned  in  the  introduction,  Gottlieb  and  several  of  his  co-investigators 
[3], [4], [5], [6], [7]  have  proposed  and  analyzed  a  technique  using  the  Gegenbauer  polyno¬ 
mials  which  also  leads  to  a  series  which  converges  exponentially  to  /  in  the  maximum 
norm  (and,  hence,  also  eliminates  the  Gibbs  phenomena).  Their  technique  requires  a 
knowledge  of  only  the  first  2N  4- 1  Fourier  coefficients  of  /,  whereas  om  method  requires 
a  knowledge  of  the  location  and  magnitude  of  the  jrunps  of  /  and  its  first  N  derivatives 
within  the  interval  [— 7r,7r].  Consequently,  since  our  technique  requires  more  “informa¬ 
tion”  about  the  function  than  Gottlieb’s  method,  it  is  not  surprising  that  our  approxima¬ 
tions  converge  much  more  rapidly  than  his  do.  In  particular,  the  error  in  his  approxima¬ 
tions  contains  a  term  proportional  to  N^iqr)^,  where  qr  =  (/5-f  2o;)^(27rea)““/5“^  <  1, 
and  a  and  P  can  be  chosen  so  that  the  convergence  rate  is  optimized.  The  correspond¬ 
ing  term  in  our  approximations  (see  Theorem  2)  is  N^^{9o/e)^,  where  we  have  set 
A  =  1  and,  hence,  M  =  N.  For  the  function  /  of  our  Example  1  (which  is  also  the 
first  example  in  [3]),  these  terms  are  (approximately)  A'^(0.4763)^  and  iV“^(0.2124)^, 
respectively.  In  Figure  14  we  have  plotted  log^o  [max  ]E(^’^^(x)|j  as  a  function  of  N 
for  Example  1  and  Example  3  using  our  approximations  and  Gottlieb’s  approximations. 
The  difference  in  the  rates  of  convergence  is  apparent  from  the  figure 

We  should  also  point  out  that  in  [3]  the  assumption  was  made  that  p  >  1,  where 


p  is  the  distance  of  the  nearest  singularity  of  /  from  the  basic  interval  [-1,1].  (The 
corresponding  assumption  for  our  analysis  would  be  that  p  >  w.)  This  condition  is 
relaxed  somewhat  in  [5].  However,  we  impose  no  such  restriction  on  om  frmctions  /. 

Several  other  methods  have  been  proposed  to  accelerate  the  convergence  of  Fourier 
series  and/or  to  eliminate  (or  at  least  mitigate)  the  Gibbs’  phenomena.  These  methods 
include  the  construction  of  Fourier-Pade  approximations  [2]  (mentioned  in  the  intro¬ 
duction),  Fej&’s  method  [1],  based  on  Cesaro  srnns,  and  Lanczos’  “sigma”  method  [11]. 
In  Figure  15,  we  have  compared  these  three  approximations  for  the  frmction  f{x)  =  x 
of  Example  1,  along  with  the  original  Fourier  series  partial  sum  (equation  (4)), 
Gottlieb’s  approximation  [3],  and  our  approximation  (equation  (14)).  It  is  inter¬ 
esting  to  note  that,  although  the  approximations  of  Fejer  and  Lanczos  have  essentially 
ehminated  the  Gibbs  phenomena,  these  approximations  are  of  poor  quality  in  an  L2 
sense.  The  simple  reason  for  this  is  that  each  of  these  methods  retains  the  same  form  of 
the  approximation  and  just  replaces  the  original  Fourier  coefficients  with  certain  other, 
modified  coefficients.  It  is  weU  known  (see  [1],  for  example)  that,  for  any  linear  combi¬ 
nation  of  a  finite  number  of  sine  and  cosine  fimctions,  the  original  Fourier  coefficients 
are  optimal  in  an  L2  sense.  Thus,  the  approximations  of  Fejer  and  Lanczos  can  be  no 
better  in  the  L2  sense  than  the  original  Fourier  series  partial  sum. 

Currently,  we  are  investigating  several  topics  related  to  the  approximations  we  have 
proposed,  and  they  will  be  discussed  in  futiue  papers.  These  topics  include  the  problem 
of  determining  estimates  of  the  locations  and  the  magnitude  of  the  jumps  in  /  and  its 
derivatives  in  the  interval  [— 7r,7r]  directly  from  the  Fourier  coefficients  of  /.  Such  esti¬ 
mates  wiU  allow  the  basis  functions  defined  here  to  be  used  in  a  manner  similar  to  that 
described  above,  when  only  a  finite  number  of  the  Fourier  coefficients  of  /  are  known. 
Some  prehminary  investigations  have  indicated  that  the  new  approximations  wiU  stiU 
retain  the  property  of  exponential  convergence,  although  the  rate  of  convergence  of  the 
new  approximations  will  undoubtedly  not  be  as  rapid  as  the  approximations  described 
here.  Applications  of  these  ideas  directly  to  the  solution  of  differential  equations  (par¬ 
ticularly,  boundary  value  problems)  are  also  being  investigated,  as  well  as  an  extension 
of  the  ideas  presented  here  to  other  orthogonal  basis  (eigenfunction)  expansions. 
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Appendix:  Derivation  of  Oq 

In  this  appendix,  we  first  present  a  brief  derivation  of  the  bound 
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(68)  ^  ^  n  1 1  - 
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2i  +  1 
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0oW  = 
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2Jl-l/(4A2) 


where  M  —  2m  -k  1  and  j  >  AM  +  1,  which  was  used  in  connection  with  the  discussion 
of  the  function  of  Example  1,  as  well  as  the  function  ho  which  was  used  in  the  proof  of 
Theorems  2-3.  To  show  that  equation  (68)  holds,  we  first  observe  that 


2ii  1  ^  2m  -hi  ^1 
2j  -  2(AM+  1)  ^ 

for  0  <  z  <  m  and  j  >  AM  +  1.  Using  this  result,  we  can  write 


Using  this  bound  in  equation  (68)  we  find,  for  all  A  >  A  >  1/2, 
(69)  <  Kd^,  k  =  (^^1  -  1/(4A2)^  ' . 


In  the  special  case  when  AM  is  an  integer,  we  can  obtain  a  sharper  bound  for  0^^ . 
(Recall  that  M  is  an  odd  integer.)  To  do  this,  we  first  define  J  =  2(AM  -f  1)  and  then 
note  that 
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(Here  we  have  used  that  usual  notation  A:!!  =  1  •  3  •  5  •  •  •  A:,  for  any  odd  integer  k.) 
Then,  using  Stirhng’s  approximation  to  the  factorial,  we  find  that  A;!!  — >■  \/^(A;/e)^/^, 
as  A:  — ^  oo.  Using  this  approximation  in  equation  (70),  we  find  that 

(71)  <k-  {Dq6q)^  ,  for  A  >  A  >  1/2, 


where 

(72) 


k  =  k{\)  = 
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We  remark  that,  although  our  derivation  is  vahd  only  for  the  case  when  AM  is 
an  integer,  the  final  result  (equations  (71)-(73))  holds  for  any  positive  value  of  A.  The 
reason  for  this  is  that  the  expression  for  A;!!  can  be  written  as  —  l)/2)!), 

and  this  expression  can  be  defined  for  noninteger  values  of  k  in  terms  of  the  Gamma 
function.  Since  the  estimate  we  used  for  A:!!  (following  equation  (70))  also  holds  for 
noninteger  values  of  k,  it  follows  that  the  expressions  (71)-(73)  hold  for  noninteger 
values  of  AM  as  well. 
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3)  The  function  /  (solid  line),  the  function  (the  barely  visible  dashed  hne), 
and  the  magnified  error  50(/  -  (dotted  line),  for  Example  1. 
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4)  The  function  /  for  Example  2  (solid  lines),  along  with  the  Fourier  series  partial 
sum  of  /  (see  equation  (4))  with  Ai  =  10  (dashed  line),  and  the  error  /  — 
(dotted  line). 


7)  The  normalized  errors  M{Xel0o)’^^ for  Example  1,  when  A  =  1  and 
M  =  5  (solid  line),  M  =  9  (dashed  line),  and  M  =  13  (dotted  line).  Note  the  more 
or  less  uniform  distribution  of  the  error  over  the  interval  [ — tt,  tt]  (especially  as  M 
increases),  as  opposed  to  the  error  in  the  original  Fourier  series  partial  sums,  which  is 
highly  concentrated  near  x  =  0. 


9)  The  normalized  errors  MiXe/9o)^ for  Example  3,  when  A  =  1  and 
M  =  b  (solid  line),  M  =  9  (dashed  line),  and  M  —  13  (dotted  line).  Note  the  more 
or  less  “uniform”  distribution  of  the  error  over  the  interval  [-7r,7r]  (especially  as  M 
increases),  as  opposed  to  the  error  in  the  original  Fourier  series  partial  sums,  which  is 
highly  concentrated  near  x  =  vr. 


11)  The  quantities  Cm  =  (max  {x)\^  /(max  J  for 

Example  4  plotted  as  a  function  of  1/M  for  A  =  1  and  for  e  =  0.1,  0.25,  0.375,  0.5,  1,  and 
2.  As  M  ^  oo,  Cm  approaches  the  asymptotic  rate  of  convergence  of  our  approximations. 
The  theoretical  asymptotic  rates  of  convergence  rj  =  tt  /Vtt^  +  e2  =  0.999  (for  e  =  0.1) 
and  (  =  6o/eX  =  0.212  are  each  indicated  by  a  short  dotted  line. 


12)  The  quantities  Cm  =  [(max  /  (max  2.a(m  2))(2;)|)]  foi 

Example  5  plotted  as  a  function  of  1/M  for  A  =  1  and  for  e  =  0.25,  0.375,  0.5,  and  1 
As  M  oo,  Cm  approaches  the  asymptotic  rate  of  convergence  of  our  approximations 
The  critical  value  Cm  =  1  is  indicated  by  the  short  dotted  line. 
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14)  A  plot  of  the  logio  {max  | Error]}  for  the  functions  of  Example  1  (dotted  lines) 
and  Example  3  (solid  lines)  using  Gottlieb’s  approximation  [3]  (diamonds)  and  the 
approximations  equation  (22)  (circles),  plotted  as  a  function  of  N. 
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15)  A  comparison  of  the  function  f{x)  =  x  of  Example  1  (denoted  by  circles) 
and  the  original  Fourier  series  partial  sum  (equation  (4)),  the  Fourier-Pade  ap¬ 
proximation  [2],  FejCT’s  approximation  [1],  Lanczos’  “sigma”  approximation  [11], 
Gottheb’s  approximation  [3],  and  the  approximation  (equation  (14)).  All  of  these 
approximations  are  based  on  only  the  first  4  terms  in  the  original  Fourier  partial  sum. 


38 


REPORT  DOCUMENTATION  PAGE 

Form  Approved 

0MB  No.  0704-0188 

1.  AGENCY  USE  ONLY^^ieai/e  blank)  I  2.  REPORT  DATE  3.  REPORT  TYPE  AN 

1  March  1995  Contractor  Repo 

D  DATES  COVERED 

rt 

4.  TITLE  AND  SUBTITLE 

EXPONENTIALLY  ACCURATE  APPROXIMATIONS  TO 

PIECE- WISE  SMOOTH  PERIODIC  FUNCTIONS 

5.  FUNDING  NUMBERS 

C  NASl-19480 

WU  505-90-52-01 

6.  AUTHOR(S) 

James  Geer 

Nana  Saheb  Banerjee 

7.  PERFORMING  ORGANIZATION  NAME(S)  AND  ADDRESS(ES) 

Institute  for  Computer  Applications  in  Science 
and  Engineering 

Mail  Stop  132C,  NASA  Langley  Research  Center 

Hampton,  VA  23681-0001 

8.  PERFORMING  ORGANIZATION 

REPORT  NUMBER 

ICASE  Report  No.  95-17 

9.  SPONSORING/MONITORING  AGENCY  NAME(S)  AND  ADDRESS(ES) 

National  Aeronautics  and  Space  Administration 

Langley  Research  Center 

Hampton,  VA  23681-0001 

10.  SPONSORING/MONITORING 

AGENCY  REPORT  NUMBER 

NASA  CR-195059 

ICASE  Report  No.  95-17 

11.  SUPPLEMENTARY  NOTES 

Langley  Technical  Monitor:  Dennis  M.  Bushnell 

Final  Report 

To  be  submitted  to  SIAM  Journal  on  Scientific  Computation 

12a.  DISTRIBUTION/AVAILABILITY  STATEMENT 

U  nclassified-U  nlimited 

Subject  Category  64 

12b.  DISTRIBUTION  CODE 

13.  ABSTRACT  (Maximum  200  words)  .  ...  ■  .  j 

A  family  of  simple,  periodic  basis  functions  with  “buUt-in”  discontinuities  are  introducer 
analyzed  and  discussed.  Some  of  their  potential  usefulness  is  illustrated  in  conjunctic 
representation  of  functions  with  discontinuities.  In  particular,  it  is  demonstrated  how  the 
a  sequence  of  approximations  which  converges  exponentially  in  the  maximum  norm  to  a  p 
The  theory  is  illustrated  with  several  examples  and  the  results  are  discussed  in  the  con 
functions  which  can  be  used  to  approximate  discontinuous  functions. 

[,  and  their  properties  are 
n  with  the  Fourier  series 
y  can  be  used  to  construct 
ece-wise  smooth  function, 
text  of  other  sequences  of 

14.  SUBJECT  TERMS 

Fourier  series;  exponential  convergence;  periodic  functions;  approximation  theory 

15.  NUMBER  OF  PAGES 

40 

16.  PRICE  CODE 

A03 

17.  SECURITY  CLASSIFICATION 

OF  REPORT 

Unclassified 

18.  SECURITY  CLASSIFICATION 
OF  THIS  PAGE 

Unclassified 

19.  SECURITY  CLASSIFICATION 
OF  ABSTRACT 

20.  LIMITATION 

OF  ABSTRACT 

NSN  7540-01-280-5500 

Prescribed  by  ANSI  Sid.  Z39-18 

298-102 


